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Abstract 

Using 9.1 fb _1 of e + e~ data collected at the T(4S) with the CLEO detector using the Cornell 
Electron Storage Ring, measurements are reported for both the branching fractions and the he- 
licity amplitudes for the decays B~ — > D*°p~ and B° — > D* + p~. The fraction of longitudinal 
polarization in B° — > D* + p~ is found to be consistent with that in B° — > D* + £~v at q 2 = M 2 
indicating that the factorization approximation works well. The longitudinal polarization in the 
B~ mode is similar. The measurements also show evidence of non-trivial final-state interaction 
phases for the helicity amplitudes. 
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Hadronic decays of heavy mesons are complicated by final-state interactions (FSI) which 
result from strong re-scattering of the products of the weak decay process. FSI effects may 
be less important if the final state is easy to produce directly via weak decay. It is also 
argued that if the final-state hadrons separate rapidly, due to a large energy release, there is 
little time for interaction. The factorization hypothesis, widely used in heavy-quark physics 
for hadronic two-body decays [1], assumes that the two hadronic currents may be treated 
independently of each other, neglecting FSI. In particular, the BSW model [l[ utilizes this 
approximation in assuming that the short and long distance QCD contributions can be 
factorized. However, the validity of the factorization hypothesis has not been demonstrated 
by any rigorous theoretical calculation. 

Korner and Goldstein 0] suggest a test of the factorization hypothesis by examining the 
polarization in B meson decays into two vector mesons. The idea is that, under the fac- 
torization hypothesis, certain hadronic decays are analogous to similar semileptonic decays 
evaluated at a fixed value of the momentum transfer, q 2 = Mj D . For instance, the polar- 
ization of the D* + meson in B° —> D* + p~ should equal that in B° —> D* + l~v at q 2 = M 2 . 
Specifically: 

i ■ i 

(1) 



££(^o ^ D* + p-) = j^(B° -> D*+ru) 



--Mj 



Here, Yl/Y is the fraction of longitudinal polarization. 

The differential decay rate for B — ► D*p~ can be expressed in terms of three complex 
helicity amplitudes H , H + and H_ as: 



<l ' 1 9 x {4|# | 2 cos 2 D . cos 2 6 P + [\H + \ 2 + \H_\ 2 ) sin 2 6 D * sin 2 9 p 



d cos 6o*d cos 9 p dx 32n 



+2 



^(H + H*_) cos 2 X - $s(H+Hl) sin 2 X sin 2 D . sin 2 



(2) 



+ [^(H + H* + H_H*) cos X - %(H+H* - H_H*) sm X ] sin20 D * sin20 p }, 



where: 0£>* is the decay angle of the D° in the D* rest frame with respect to the D* line of 
flight in the B rest frame; 9 p is the decay angle of the n~ in the p~ rest frame with respect 
to the p~ line of flight in the B rest frame; x is the angle between the decay planes of the 
D* and p; and 3f?(x) and $t(x) denote the real and imaginary parts of x, respectively. 
The longitudinal and transverse polarizations are then defined as: 
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(3) 



and 

^ = 1 - ^ (4) 

r r ' 1 ] 

respectively. 

Previous measurements have been performed on the D*p system. Using 0.89 fb^ 1 of T(AS) 
data and performing an unbinned two-dimensional likelihood fit to the joint (_cos0d*, cos0 p ) 
distribution, the CLEO Collaboration measured Yl/Y = 0.93 ± 0.05 ± 0.05 |3j. Later, using 
3.1 fb _1 of T(45) data and performing an unbinned maximum likelihood fit to the joint 
three-dimensional (cos 0b* , cos0 p , x) distribution, along with the invariant B and/? mass 
distributions, CLEO reported a preliminary result of Y L /Y = 0.878 ±0.034 ±0.030 J. Both 
results are in agreement with the theoretical prediction of 0.895 ±0.019 for B° — > D* + p~ 0. 
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Testing the factorization hypothesis would benefit from further reduction of the experimental 
uncertainty. We report here an improved measurement using ten times the data of the first 
measurement. This represents the final update of the second analysis and uses largely the 
same technique, but with some important improvements in both the event selection and the 
treatment of acceptance. Our results include the data used in the previous analyses and 
hence supersede them. 

The data used in this analysis were collected at the Cornell Electron Storage Ring (CESR) 
with the CLEO detector in two configurations, known as CLEO II 6] and CLEO II. V Q. 
The data consist of an integrated luminosity of 9.1 fb _1 collected at the T(4S') resonance, 
corresponding to 9.7 x 10 6 BB events, as well as 4.6 fb~ x of continuum data at energies 
just below the T(4S) resonance. The latter is used to study the backgrounds due to the 
non-resonant e + e~ — > qq process. 

In CLEO II, the momentum measurement of charged particles is carried out with a track- 
ing system consisting of a six-layer straw-tube chamber, a ten-layer precision drift chamber, 
and a 51-layer main drift chamber. The tracking system operates inside a 1.5 T supercon- 
ducting solenoid. For charged particles, the main drift chamber also provides a measurement 
of ionization energy loss (dE/dx), which is used for particle identification. The CLEO II. V 
detector was upgraded in two main aspects, both affecting charged particles. First, the 
straw-tube chamber was replaced with a three-layer double-sided silicon vertex detector; 
and second, the gas in the main drift chamber was changed from an argon-ethane to a 
helium-propane mixture. Photons are detected with a 7800-crystal CsI(Tl) electromagnetic 
calorimeter, which is also inside the solenoid. Muons are identified with proportional cham- 
bers placed at various depths within the steel return yoke of the magnet. 

Charged tracks with momenta greater than 250 MeV/c are required to come from the 
interaction point and be well-measured (based on the quality of the track fit and the number 
of hits). Identified electrons and muons are excluded, and pions and kaons are required to 
have a measured dE/dx within 2.5 standard deviations (cr) of their expected values. To 
keep the efficiency high, softer tracks are only required to satisfy a looser requirement of 
consistency with originating at the interaction point. The 7r° candidates are formed from 
pairs of photons with an invariant mass within 2.5 standard deviations of the known 7r° 
mass. These pairs are then kinematically fitted with their invariant mass constrained to 
the known n° mass. The x 2 °f this kinematic fit must be less than nine. To suppress 
background from fake photons, the constituent photons of the 7r° must be detected in the 
central barrel calorimeter (which has the least material shadowing it) and have a minimum 
energy of 30 — 65 MeV, depending on the source (D*°, D°, or p~) of the 7r°. 

We reconstruct candidate D*° and D* + mesons in the modes D*° — > D 7t° and D* + — > 
D°7r + , with D° — > K~7t + , D° — > K~-k + 7t , or D° — > K~7t + 7t~tt + . Throughout this paper, 
charge conjugate modes are implied. The reconstructed D* — D mass differences and the 
D° invariant mass are required to be within 2.5<r of the nominal values. The resolutions 
of these quantities are obtained from Monte Carlo simulations, and the D° — > K~7t + tt° 
resolution includes a n° energy dependence. We also require the D° — > K~7i + ti candidates 
to come from the more densely populated regions of the Dalitz plot to suppress combinatoric 
background. Candidate p~ mesons are selected from 7t~n° combinations which have an 
invariant mass within 150 MeV/c 2 of the nominal p~ mass. 

The B~ and B° mesons are reconstructed by combining the D*° or D* + candidates with 
the p~ . We calculate a beam-constrained B mass by substituting the beam energy [Eb] 

for the measured B~ or B° candidate energy (J2iEi)'- M = J El — ps 2 , where ps is the 
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measured momentum of the B candidate. This improves the M resolution by one order of 
magnitude, to about 3 MeV/c 2 . The difference between the reconstructed energy of the B~ 
or B° candidates and the beam energy, AE = J2iEi — Ej,, is required to be to within 2.5a. 
The resolution of the energy difference varies from 10 MeV to 35 MeV, depending on the 
decay mode, and is also obtained from Monte Carlo simulations. We also account for the 
dependence of our AE resolution on the 7r° (from the p~ decay) energy, parameterizing it 
function of cos#„. 

To suppress background from the continuum under the T(4S) resonance, only events with 
a ratio of Fox- Wolfram moments 0, i?2 < 0.5, are used, taking advantage of the fact that 
this ratio is larger for the more jet-like events from the continuum than the more spherical 
events from BB decays of the T(45). We require that the polar angle of the reconstructed 
B satisfies | cos#b| < 0.95, given the known sin 2 #b distribution for T(45) decay. Finally, a 
requirement is made on the cosine of the sphericity angle, 0$, defined as the angle between 
the sphericity axis of the B decay products and the rest of the particles in the event. Because 
of their two-jet structure, continuum events peak strongly at | cos Qg\ = 1> while signal events 
are flat. Only candidates with | cos Q$\ below a maximum allowed value, dependent on the 
D° decay mode, are retained. 

To measure both the branching fractions and the polarization in the decay of B — > D*p, 
we perform an unbinned maximum likelihood fit to extract the number of signal events and 
the helicity amplitudes from the data. Events from the three D° decay modes are combined 
in the fit. The likelihood function, C, has the form: 

3 er^f 2* n| ■ Vfj(M, m, cosflp*, cos9 p , x) + nf ; ggCjg, rn, cos9 D *,cos9 p , X ) 
M "jl l\ ' nf + nf 

(5) 

where m is the invariant mass of the candidate p meson, rij and nf are the number of 
signal and background events for the j-th D° decay mode, respectively (vj — + nf), and 
nj is the total number of data events for the j-th D° decay mode. 

The signal probability distribution function, 7^(M, m, cos#d*, cos0 p , %), is composed of 
two parts. The mass distribution part is a product of the beam-constrained B invari- 
ant mass distribution (assumed to have a Gaussian probability distribution) and a Blatt- 
Weisskopf form-factor-modeled [9] Breit-Wigner shape for the p~ invariant mass distribu- 
tion; the angular distribution part is given by Eq. (J2J), multiplied by the detector acceptance, 
e(cos D *,cos0p,x)- 

The background probability distribution function, VS(M, m, cos#d*, cos9 p , x), also has 
two components: the product of an ARGUS-type background function [lOj for the beam- 
constrained B invariant mass and a flat distribution for the ir~n° invariant mass distribution; 
and an angular distribution for the background determined from events in the B mass 
sideband, defined as 5.200 < M < 5.265 GeV/c 2 . The background shape is parameterized as 
a product of second-order polynomials in cos 9b* and cos 9 P and the function l+P x cos(x+xo) 
in x, where P x and xo are allowed to vary in the fit to the sideband data. 

To extract the number of signal and background events, the reconstructed candidates 
with 5.20 < M < 5.30 GeV/c 2 are fit, and the angular distributions in both the signal and 
background probability density functions are ignored. Figure ^ shows the beam-constrained 
mass distributions for both B~ and B°. 

The efficiencies of the B selection procedure for the three D° decay modes are determined 
from Monte Carlo simulations. Table |I| gives the number of signal events and the efficiencies, 
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FIG. 1: B~ (top) and B° (bottom) candidate mass distributions from the data, along with the 
results of the fits. Dashed curves indicate the ARGUS-type background. 

where the uncertainties are statistical only. 

TABLE I: Number of signal events and the efficiencies for B~ — > D*°p~ and B° — > D* + p~ for the 
three D° decay modes. The uncertainties shown are statistical only. 



B type 


D decay mode 


n s 


e (%) 


B~ 


K-TT+ 


148.9 ± 13.8 


6.56 ± 0.04 




177.4 ± 16.6 


2.20 ±0.02 




136.0 ± 15.2 


3.04 ±0.03 


B° 


K~7r + 


196.3 ± 14.6 


10.88 ± 0.05 


K-1T+TT 


196.1 ± 16.4 


3.67 ±0.03 




170.6 ± 13.9 


4.46 ± 0.03 




Assuming equal production of B + B and B°B° at the T(4S), the resulting measured 
branching fractions are B(B~ -> D*°p-) = (0.98 ± 0.06 ± 0.16 ± 0.05)% and 
B(B° -> D* + p-) = (0.68 ± 0.03 ± 0.09 ± 0.02)% i which compare well withprevi- 
ous measurements 0|, the recent BaBar measurement anc i the world average A 



statistical uncertainty and two systematic uncertainties are quoted in the branching frac- 
tions. The first systematic error includes uncertainties in the number of produced BB pairs 
(2%), the background shape (3%), our Monte Carlo statistics (1 — 2%), and the charged 
particle tracking and n° detection efficiencies (10 — 18%). The second systematic error 
comes from uncertainties in the D* and D° decay branching fractions. The contributions 
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from non-resonant D*im° and other non-p - components are small jyj and neglected. The 
contribution from the helicity amplitude dependence of the efficiency is less than 11% of the 
corresponding contribution from the Monte Carlo statistics, and hence, is also ignored. 

These branching fraction measurements and the BSW prediction for B(B~ — > 
D*°p~)/B(B° — > D* + p~) 0|, can be used to extract the ratio of the effective cou- 
pling strengths for color-suppressed modes (a 2 ) and color-enhanced modes (ai) for the 
D*p final state. The extraction of 02/01 is sensitive to the B + B~ and B°B° produc- 
tion fractions; we used /+_//oo = 1-072 ± 0.045 ± 0.027 ± 0.024 Q. Our data give 
02/^1 = 0.21 ± 0.03 ± 0.05 ± 0.04 ± 0.04, where the fourth uncertainty, from /+-//00, is 
important here since other experimental systematics partially cancel. This result is in good 
agreement with the previous CLEO measurement and others 

To extract the helicity amplitudes from the data, only the reconstructed B events in the 
B signal region (defined as 5.27 < M < 5.30 GeV/c 2 ) are included in the fit. The number 
of signal and background events for the three D° decay modes are taken from the previous 
mass fit, with the latter scaled to the B signal region. 

The dependence of the acceptance on the decay angles, combined with the effects of 
detector resolution, are determined from Monte Carlo simulations. Due to the a priori un- 
known helicity amplitudes, a weighting technique based on Eq. (J2J) is employed to adjust 
the acceptance for different helicity amplitudes. Fits are iterated until the helicity ampli- 
tudes used for weighting and those resulting from the fit converge. Our study shows that 
the acceptance over the angle x is quite flat and thus the acceptance can be factorized 
as e(cos#o», cos# p , x) = e 2 (cos6 D *, cos# p )ei(x) with ti(x) = Qo(l + Qi sin X + Q2 cosx + 
Q 3 sin 2x + Qa cos 2%) and Qi, 2,3,4 are all found to be small. We use the following functional 
form to fit the two-dimensional acceptance from the weighted Monte Carlo: 

e 2 (cos 9d*, cos 6 p ) = 

1 + Pi cos 2 6 D * + P 2 cos 2 B p + P 3 cos 2 6 D * cos 2 6 p 
00 1 + P w cos 2 8 D * + Pn cos 2 6 P + P\2 cos 2 8d* cos 2 6 p 
■ exp(— P 4 cos Qd* — P5 cos 2 9d* — P& cos 3 Or,* — P 7 cos 9 P — Pg cos 2 9 P — Pg cos 3 9 P ). 

(6) 

This gives an excellent fit with no discernible pattern of residuals. 

Performing the unbinned maximum likelihood fit, we obtain the helicity amplitudes for 
the decay B — > D*p listed in Table El Figure 121 shows the one-dimensional angular distri- 
butions and the projections from the fit. The errors quoted in the table are the statistical 
and systematic uncertainties, respectively. 

The sources of systematic uncertainty are the acceptance parameterization, detector 
smearing, background level and shape, non-resonant 7t~tt° contribution, and the polariza- 
tion dependence on the mass of the p~ meson. Their individual contributions are shown in 
Table IIHI For the acceptance parameterization, we use different functional forms for both 
e2(cos6 ) £>*, cos# p ) and ei(x) in the maximum likelihood fit, and the changes of the helicity 
amplitudes are taken as the systematic uncertainties. To gauge the effect of detector smear- 
ing, we increase the smearing in the nominal Monte Carlo by a conservative 15% of itself. 
We increase the number of background events for each D° decay mode independently by 
lcr and use the observed shifts as the corresponding systematic uncertainties. Our largest 
systematic uncertainty comes from the shape of the background angular distribution. We 
compare the nominal fit results to three other fits: one with the background flat in the decay 
angles, one with the shape fit to the Monte Carlo events in the M sideband, and one with the 
shape fit to the non-signal Monte Carlo events in the M peak region. The largest variation 
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FIG. 2: The cos Op* (left), cos6 p (middle) and x (right) distributions for B — > (top) and 

B° —¥ D* + p~~ (bottom) from the data (dots) and the corresponding fit projections (histograms). 

TABLE II: The measured helicity amplitudes for B~ — > D*°p~ and B° — > D* + p~ . The phase of Hq 
is fixed to zero in each mode. a+ and a_ are the phases, in radians, of H + and H_, respectively: 
H± = \H± \ exp(ia±). 



Quantity 


Br -> D*°p~ 


go _^ D*+ p - 


l-Hol 


0.944 ± 0.009 ± 0.009 


0.941 ± 0.009 ± 0.006 


\H+\ 


0.122 ±0.040 ±0.010 


0.107 ±0.031 ±0.011 


a+ 


1.02 ±0.28 ±0.11 


1.42 ±0.27 ±0.04 


\H-\ 


0.306 ± 0.030 ± 0.025 


0.322 ±0.025 ±0.016 




0.65 ±0.16 ±0.04 


0.31 ±0.12 ±0.04 



among these three is taken as the systematic uncertainty. To account for a background con- 
tribution from non-resonant 7r~7r° combinations in the data sample, an S— wave component 
with a flat angular distribution is added in the helicity angular distribution. Finally, we 
include a systematic uncertainty due to our sensitivity to the q 2 dependence of the helicity 
amplitudes. In the nominal fit, we ignore this possible dependence. Instead, we relate the 
helicity amplitudes at a momentum transfer q 2 = M 2 to the actual q 2 of the events, using 
the factorization hypothesis, and we use the shifts as the uncertainty. The total systematic 
uncertainty is then the sum of the above contributions in quadrature. 

As can be seen from Table |HJ our results indicate possible non-trivial helicity amplitude 
phases, a + and a_. To better gauge the significance of such a conclusion, we use the 
quantity v/A(— 2 In C ma x), where A refers to the increase in —2 In C max when both phases 
are forced to be zero, as compared to the nominal fit with floating phases. Interpreting this 
quantity as the net statistical significance of non-zero phases, we find 3.19a and 2.75a for 
B~ — ► D*°p~ and B° — ► D* + p~, respectively. The stability of the significance is evaluated 
by examining the changes in ^A(— 2 In C max ) for all of the systematic variations discussed 
above. The values are quite stable, ranging from 3.09 — 3.54a and 2.65 — 2.83a for B~ 
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TABLE III: Summary of the systematic uncertainties for the helicity amplitudes of B 
and B° — > D* + p~, respectively. 



D 



D*°p- 


All xlO" 2 


Quantity 


Accep. 


Smearing 


Bkg. level 


Bkg. shape 


Non-res. 


q 2 dep. 


Total 


Wo\ 


0.08 


0.06 


0.13 


0.83 


0.01 


0.07 


0.85 


\H+\ 


0.32 


0.25 


0.37 


0.60 


0.23 


0.43 


0.95 


a + 


2.23 


1.90 


2.96 


9.82 


0.71 


1.59 


10.81 


\H-\ 


0.24 


0.28 


0.30 


2.45 


0.08 


0.03 


2.50 


a_ 


1.29 


1.12 


2.22 


1.07 


1.02 


2.84 


4.25 


r L /r 


0.14 


0.11 


0.25 


1.58 


0.01 


0.12 


1.62 


D* + p- 


All xlO" 2 


Quantity 


Accep. 


Smearing 


Bkg. level 


Bkg. shape 


Non-res. 


q 2 dep. 


Total 


\H \ 


0.07 


0.01 


0.04 


0.61 


0.13 


0.10 


0.63 


\H+\ 


0.25 


0.01 


0.09 


0.92 


0.44 


0.09 


1.06 


a+ 


2.17 


0.18 


1.64 


2.12 


2.17 


1.35 


4.29 


\H-\ 


0.20 


0.03 


0.13 


1.52 


0.06 


0.26 


1.56 


a.- 


0.92 


0.01 


0.39 


3.95 


0.18 


0.16 


4.08 


r L /r 


0.13 


0.02 


0.07 


1.14 


0.25 


0.19 


1.19 



and B°, respectively. Previously, indications of FSI phases have also been reported in the 
Dn [15[ and the J/ipK* systems [l6| . 

The results for the helicity amplitudes correspond to 



0.892 ±0.018 ±0.016, 
0.885 ±0.016 ±0.012, 



(7) 



where the two uncertainties are statistical and systematic, respectively. Within the uncer- 
tainties, the fraction of longitudinal polarization for B° — > D* + p~ is in good agreement with 
the previous CLEO measurement and with the HQET prediction of 0.895±0.019 |E| using 
factorization and the measurements of the semileptonic form factors. Longitudinal polariza- 
tion as a function of q 2 is plotted in Figure El for such a prediction and compared with our 
new D* + p~ result, as well as previous measurements for D* + p'~ [ItJ and D* + D*~ ^if. The 
agreement is excellent, indicating that the factorization hypothesis works well at the level 
of the current uncertainties. 

In summary, we have measured both the branching fractions and the helicity amplitudes 
for B — > D*p. The values of the branching fractions, the ratio 02/01, and the degree of 
longitudinal polarization are in good agreement with previous measurements and with the- 
oretical predictions. The measurement of the fraction of longitudinal polarization confirms 
the validity of the factorization assumption at relatively low q 2 . Finally, the measurement of 
the helicity amplitudes indicates a strong possibility of non-trivial helicity amplitude phases 
which would arise from final-state interactions. Such phases are of interest since they are 
required for the observation of direct CP violation in B decay rates 2( 
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FIG. 3: The fraction of longitudinal polarization in B° —* D* + X decays as a function of q 2 = M|, 
where X is a vector meson. Shown are the current B° — > D* + p~ polarization measurement, 
and earlier measurements of B° — > D* + p'~ |r7j |. and B° — > D* + D*~ The shaded region 

represents the prediction using factorization and HQET, and extrapolating from the semileptonic 
B° — > D* + l~v form factor results The shaded contour shows a one standard deviation 

variation in the theoretical prediction. 
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